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PATENT APPLICATION ABSTRACT 

The field of technology of the invention relates to 
digital data imagery compression and storage. The general 
application or field of use is for electronic transmission 
and/or storage of radiological data (teleradiology) , such as 

high volume data for X-ray imagery. 

With reference to application Figure 1, an initial read 
step 1 obtains a subject image containing digital imagery 
data. Modeling step 2 of the subject image is preformed 
upon a three-dimensional model to provide a modeled subject 
image. The registration process 3 registers the modeled 
subject image with a modeled reference image obtained from 
modeling a relatively unrelated standard reference image 
upon the same three-dimensional model. Registration results 
in the modeled subject image and modeled reference image 
being translationally correlated, with the resulting corre- 
lation thereof in spatial and spectral dimensions. A sub- 
traction or differencing process 4 is performed for the 
modeled reference image and the modeled subject image to 
form a differenced image. A compression operation 5 is 
performed on the differenced image to provide a compressed 
differenced image, which may be subsequently transmitted 
and/or stored for subsequent decompression and addition 
processing to obtain an approximated subject image at either 
a remote location and/or at a remote period in time. 

The present invention permits image compression through 
differencing of images which are spatially relatively 
uncorrelated f i.e. . the subject image and the reference 
image) . Permitting the two images involved in the 
differencing operation to be relatively uncorrelated is 
particularly advantageous for applicability of the system in 
general teleradiology and digital image storage applica- 
tions. With such two images being acquired separately and 
independently from one another, optional compression and 
storage of a small, interactively operator-selected region 



of interest permits overall compression ratios of 100:1, 
even for thoracic X-rays. 
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Attorney Docket No.: SSC -o 00 10-1 

TITLE: DIGITAL DATA REGISTRATION AND DIFFERENCING 

COMPRESSION SYSTEM 

ORIGIN OF THE INVENTION 

The invention described herein was made in performance 
of work under a NASA contract, and is subject to the provi- 
sions of Section 305 of the National Aeronautics and Space 
Act of 1958, Public Law 85-568 (72 Stat. 435; 42 U.S.C. 

§ 2457). 

BACKGROUND OF THE INVENTION 

This invention generally concerns a digital data 
compression system capable of reducing transmission time and 
storage requirements, and particularly concerns compression 
and subsequent decompression of digital data images, such as 
X-rays, which are inherently similar in many respects; and, 
wherefore, a priori knowledge of such images can be used in 
their compression. 

Although the preferred areas of application (and the 
following discussion of background and description) of the 
invention pertain mainly to the medical and teleradiological 
fields, similar problems as discussed herein exist in other 
similar systems which deal with the compression and storage 
of large amounts of digital data; accordingly, advantages 
and benefits of this invention are equally applicable to 
such other systems. With such an understanding, it should 
be appreciated that the following discussion of specific 
exemplary present embodiments is in no way meant to limit 
the scope of the present invention to strictly medical 
applications. 

Electronic transmission of various types of digital 
data, in particular radiological data (teleradiology) , 
involves the transmission of a tremendous volume of data. 
Unless expensive broadband systems are used, such high data 
volume causes the transmission process to be relatively 
slow, and with the quality of the transmitted image often 



deteriorated. In the case of teleradiology, the transmis- 
sion time is crucial for prompt analysis of a patient's 
condition and the sharing of analytical expertise between 
hospitals, clinics, and the like. 

State of the art radiological systems produce digital 
imagery which may contain one megabyte of data per image. 
Since there is information throughout the frame, systems 
which attempt to transmit for example chest X-rays must 
process the entire volume of image data. Because of such 
large volume of data, most systems include relatively expen- 
sive image compression schemes. The efficiency of compres- 
sion can be measured by the ratio of the necessary storage 
size before compression to the necessary storage size after 
compression (compression ratio) . However, the compression 
algorithms incorporated in such schemes rarely achieve 
compression ratios greater than 5:1. State of the art image 
transmission systems incorporating conventional image com- 
pression and using 9600 baud telephone lines still require 
more than six minutes for the transmission of one 
1024 x 1024 image. 

Storage of the imagery data is also a problem. One 
uncompressed image requires approximately one megabyte of 
storage space, obviously necessitating considerable storage 
capability to maintain a library of any significant number 
of different digital images. 

Various forms of digital image differencing for image 
compression and digital image differencing for image 
enhancement are known. However, such differencing methods 
of the prior art do not provide features and advantages of 
the present invention. 

Methods which perform differencing for image 
enhancement generally aim to enhance images by removing 
contrast detail information which is similar in the images. 
In such cases, the information in the difference image is* 
typically presumed to be diagnostically interesting. The 



difference image contains sharply reduced intensity values 
in the regions where the contrast detail of the original 
images was similar, and normal intensity values in the 
regions where there were appreciable differences. Hence, 
contrast between such forms of difference information and 
the background is enhanced. Such prior method of image 
enhancement is often used in medical imaging to examine 
changes in the medical condition of specific parts of 
anatomy or to visualize vessels and cavities by subtracting 
images taken before and after some tracer element is 
injected ( e.g. . Digital Subtraction Angiography) . 

The difference image obtained with the foregoing often 
contains less contrast detail than the original images. At 
a minimum, if the original images were similar, the inten- 
sity values of most pixels in the difference image are low. 
This, however, does not mean that the size of the difference 
image ( i . e . . the volume of data) is smaller than that of the 
original image. Indeed, a difference image which entirely 
comprises eight bit, low intensity pixels is as large as an 
original image which contain the same number of eight bit 
pixels, but which displays maximum contrast detail. 

U.S. Patent No. 3,905,045 to Nickel concerns an 
apparatus for image processing using a plurality of opera- 
tions in sequence to produce a difference image, including 
bilinear mapping of one image on the other to register the 
images and photoequalization to generate a difference image. 
Image warp transformation is disclosed using operator 
selected match points on a pair of images, along with an 
image correlation process using a second group of matching 
points. The size of the differenced image is, however, as 
large as either of the two original images, wherefore no 
compression is achieved. 

U.S. Patent No. 4,533,947 to Smith discloses a method 
for increasing the data storage transfer rate in a system 'to 
permit the recording of a rapid sequence of high resolution 
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images by eliminating designated portions of each image in 
the sequence. The disclosed method operates on the premise 
that two images which are related, particularly through 
temporal continuity, have similar intensity values over a 
5 significant portion of the pixel matrix. Portions of the 

image where pixel values have not changed beyond some thres- 
hold from corresponding portions in a related image are 
recognized, and those image portions where significant 
change is indicated are transmitted. A high degree of 
10 spatial correlation is assumed between the image matrices 

before they enter the‘ system. The method does not accom- 
modate situations in which images do not match because of 
differences such as in orientation, location, gray scale 
intensity range, and scale of component elements. Such may 
15 be typical whenever images are not recorded in rapid 

sequence. 

U.S. Patent No. 4,742,558 to Ishibashi et al. discloses 
a method for the reduction of codes necessary to display a 
designated image area contained in a global image. An 
20 original image is represented by a hierarchical structure 

from a global image of high level to a local image of low 
level. Only difference information between the images of 
the respective levels is coded and stored so that the number 
of codes will not be increased. The method includes a step. 
25 in which differencing of image data takes place, but one 

image is not differenced from another relatively unrelated 
image. Rather, the image is compared to and differenced 
from itself. The objective is apparently not to reduce 
image data but to reduce the cost of splitting the image 
30 into several levels of a hierarchical structure according to 

different resolutions of the image. 

U.S. Patent No. 4,802,093 to Ema discloses an X-ray 
image processing apparatus which performs image differencing 
and gray scale transformation to reduce the gray scale % 
differences between images prior to differencing. The 
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invention relates to image enhancement by digital differenc- 
ing such as Digital Subtraction Angiography (DSA) . The 
system transforms the gray scales of the respective images 
to minimize the total intensity difference between them. 

This results in a difference image whereby the background to 
the contrast enhanced areas has lower intensity values, 
making the contrast enhanced areas more visible. 

U.S. Patent No. 4,809,350 to Shimoni et al. discloses 
an image compression system which mathematically approxi- 
mates the image function and defines the difference image as 
the difference between the image and the approximating 
model. An image is used to predict itself and the model is 
subsequently used in the differencing operation. Although 
steps of acquisition, image subtraction, compression, 
storage, decompression, and image addition are disclosed, 
the differencing method is fundamentally different from the 
present invention. Shimoni et al. is inherently limited as 
an effective system because, for example, it uses an 
inherently related image in the subtraction process, while 
the present invention advantageously makes use of a 
relatively unrelated reference image. The fact that the 
images of the present invention are not inherently related 
allows greater flexibility and higher compression ratios as 
explained in the DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS . 

U.S. Patent No. 4,685,146 to Fenster et al. discloses a 
method for correcting for artifacts generated by object- 
motion caused misregistration between different images. 
Enhancement is provided through image differencing, and in 
particular a method is disclosed for assuring valid regis- 
tration of images to be compared to obtain image enhancement 
with minimal artifacts. 

U.S. Patent No. 4,635,293 to Watanabe and U.S. Patent 
No. 4,644,582 to Morishita et al. also generally disclose' 
various methods for image registration and alignment. 
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SUMMARY O F THE INVENTION 

The present invention recognizes and addresses various 
of the foregoing problems and shortcomings, and others, 
concerning digital imagery generally. This invention more 
5 particularly addresses the expense and time required for the 

transmission and/or storage of an image containing a large 
volume of digital data, especially in the field of teler- 
adiology. Accordingly, it is one principal object of the 
present invention to provide an improved method for digital 
10 image compression which reduces transmission time and/or 

storage requirements.* It is an additional object to provide 
for effective decompression of the transmitted and/or stored 
data. 

A further object of the present invention is to provide 
15 a method which makes more efficient and effective use of 

present conventional compression algorithms. 

It is also an object of the present invention to 
provide a method that enables separation and amplification 
of diagnostically significant data contained in a larger 
20 image, thereby providing a useful diagnostic tool. 

Another object of the present invention is to provide a 
method of image compression that achieves a far greater 
overall compression ratio than conventional compression 
systems . 

25 Yet another object of the present invention is to 

provide a method of producing an image that is less severely 
distorted by potent compression algorithms, thereby allowing 
for stronger compression tools. 

Another principal object of the present invention is to 
30 provide a method whereby relatively insignificant data can 

be edited from a subject image prior to compression yet 
still be represented in the final approximation of the same 
subject image. 

Still another object of the present invention is to * 

35 provide an effective differencing and compression system 



capable of use for relatively unrelated and uncorrelated 
Images . 

Additional objects and advantages of the invention will 
be set forth in part in the description which follows, and 
in part, will be obvious from the description or may be 
learned by practice of the invention. The objects and 
advantages of the invention may be realized and attained by 
means of the instrumentalities and combinations pointed out 
in the appended claims. 

Also, it should be appreciated that modifications and 
variations to the specifically illustrated and discussed 
features and steps hereof may be practiced in various 
embodiments and uses of this invention without departing 
from the spirit and scope thereof, by virtue of present 
reference thereto. Such variations may include, but are not 
limited to, substitution of equivalent steps and features 
for those shown or discussed, and the functional or posi- 
tional reversal of various steps, or the like, where no 
substantial change to the present invention results. 

Still further, it is to be understood that different 
embodiments, as well as different presently preferred 
embodiments, of the present invention may include various 
combinations of presently disclosed features, steps, or 
their equivalents (including combinations thereof not 
expressly shown or stated) . 

To achieve the present objects and in accordance with 
the purpose and spirit of the invention as embodied and 
broadly described herein, one exemplary method of the 
present invention for the compression of digital imagery 
data comprises the steps of: obtaining a subject image con- 
taining digital imagery data; modeling the subject image 
upon a three-dimensional model to provide a modeled subject 
image; performing registration of the modeled subject image 
with a modeled reference image obtained from modeling a % 
relatively unrelated standard reference image upon the 



three-dimensional model, so that the modeled subject image 
and modeled reference image are translationally correlated, 
with resulting correlation of the modeled images in spatial 
and spectral dimensions; differencing the modeled reference 
image and the modeled subject image to form a differenced 
image; and compressing the differenced image to provide a 
compressed differenced image. 

The invention is applicable generally to any situation 
where a large volume of data is desired to be transferred at 
high speed; accordingly, it is within the scope and spirit 
of the present invention to include all such applications of 
the teachings hereof. Although radiography and X-rays will 
be discussed in describing the invention, it should be 
understood that such is for the purpose of disclosing 
present preferred embodiments and not for limiting the scope 
of the invention to one area. 

The subject image may be formed with one of any known 
type of digital imagery, for example X-rays, and preferably, 
obtaining the subject image can be by way of any known 
conventional method, for example, use of digital 
radiographic systems. 

Presently disclosed interactive editing of the subject 
image preferably comprises identifying an area of interest 
on the subject image through operator selection. In one 
alternative embodiment, such editing may be accomplished 
automatically by computer identification of a predetermined 
area of the subject image (such as based on "advance" 
operator selection through programming) . This may be 
accomplished by gray scale value discrimination, pixel con- 
trast intensity, pixel location, or any other applicable 
method . 

In one preferred embodiment, interactive editing is 
accomplished by an operator viewing the subject image and 
designating the area of interest. For example, the operator 
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may view a subject image upon a CRT screen and designate the 
area of interest such as through use of a light pencil. 

The feature of modeling a subject image upon a three- 
dimensional model representative of a particular element 
5 contained in the subject image preferably includes steps 

whereby a two-dimensional subject image is "transformed" 
into a three-dimensional representation based upon the 
three-dimensional model. The term "based upon" refers to 
the fact that the three-dimensional model need not be an 
10 exact (scale, location, aspect, etc.) model of a particular 

element of the subject image but can be merely representa- 
tive of an .element contained in the image. The modeling 
operation correlates the subject image to the model so that 
the three-dimensional representation is said to fit the 
15 model. The subject image is correlated to the model; the 

model is not correlated to the subject image. 

In one preferred embodiment of the present invention, 
modeling features include an image warping operation which 
emulates three-dimensional transformation. The image warp- 
20 ing operation may employ known image warping algorithms to 

transform the two-dimensional subject image into a three- 
dimensional representation of itself and back into a two- 
dimensional modeled image with reassigned pixel values 
corresponding to the three-dimensional representation. 

25 In a further embodiment of the present invention, the 

three-dimensional model comprises a computer-generated model 
representative of a component element common to the subject 
image and the reference image. 

In yet another embodiment of the invention, the 
30 standard reference image is capable of being correlated with 

subject images originating from more than one source. For 
example, a single standard reference image can be correlated 
with a subject image from sources A, B, or C. There is no 
necessity that a reference image be compatible with only % 
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subject images from one source, or that the reference image 
itself originates from the same source as the subject image. 

In a further, alternative preferred embodiment, a 
region smoothing operation may be applied to the differenced 
image to decrease noise therefrom. 

In one embodiment of the invention, the compression of 
the differenced area of interest is accomplished with con- 
ventional compression algorithms, so as to allow for more 
efficient use of the algorithms resulting in relatively 
greatly increased compression ratios over prior usage of the 
same algorithms . * 

In acc.ordance with yet a further alternative feature of 
the invention, an enhanced intermediary storage capability 
may be provided whereby the differenced image can be stored 
for subsequent recall and decompression thereof. Such 
intermediary storage capability can be provided at the situs 
of compression prior to any data transmission, at a receiv- 
ing station prior to decompression, or at some intermediary 
storage facility. 

To further achieve present objects and in accordance 
with purposes of the invention, as embodied and broadly 
described herein, there is provided a method for the 
effective compression and transmission of radiographic 
imagery exploiting prior known information of the image. 

Such method comprises first obtaining a subject X-ray which 
contains data of relative diagnostic importance. Interac- 
tive editing of the subject X-ray results in operator selec- 
tion of an area of interest encompassing at least the 
diagnostically important data. The subject X-ray is then 
modeled upon a three-dimensional model representative of a 
particular element contained in the subject X-ray to provide 
a modeled subject X-ray. The modeled subject X-ray is 
registered with a modeled reference X-ray which is obtained 
by modeling a relatively unrelated standard reference X-r&y 
upon the same three-dimensional model as the subject X-ray 



was modeled upon. Such standard reference X-ray preferably 
comprises the relative equivalent of the subject X-ray 
without the diagnostically important data. 

With the foregoing steps, the modeled images, by being 
modeled upon the same three-dimensional model, are trans- 
lationally correlated during the registration operation to 
provide for correlation of the modeled images in spatial and 
spectral dimensions. After being so registered, the modeled 
subject X-ray and the modeled reference X-ray are 
differenced, providing a differenced X-ray which includes 
the previously identified area of interest. The differenced 
X-ray is (optionally) subsequently reduced to eliminate 
undesired portions therefrom which further significantly 
reduces the amount of data to be compressed, such reduction 
(if practiced) providing a reduced differenced X-ray includ- 
ing at least the area of interest. Enhanced compression of 
at least the area of interest of the differenced X-ray 
(after reduction, if practiced) provides a compressed 
differenced X-ray. 

The compressed differenced X-ray may then be 
transmitted if desired to a predetermined receiving station 
so that the compressed area of interest can be subsequently 
decompressed for addition to a duplicate of the standard 
reference X-ray. Such addition yields a relatively precise 
approximation of the original subject image. Alternatively 
to transmission, local storage may be practiced with the 
same subsequent decompression/addition operations available 
for image recall function. 

In another preferred embodiment of the invention, the 
three-dimensional model comprises a computer-generated model 
of a human thorax with the subject and reference X-rays 
being modeled thereupon. 

In yet another preferred embodiment of the invention, 
the subject X-ray comprises a chest X-ray and the standard 
reference X-ray comprises a "healthy" chest X-ray without 



diagnostically important data. Preferably, the standard 
reference X-ray is compatible with subject X-rays originat- 
ing from various sources and is not restricted to use with 
subject X-rays originating from the same source. 

Those of ordinary skill in the art will better 
appreciate the features and aspects of such embodiments, and 
others, upon review of the remainder of the specification. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A full and enabling disclosure of the present 
invention, including the best mode thereof, directed to one 
of ordinary skill in the art, is set forth in the remainder 
of the specification, which makes reference to the appended 
figures, in which: 

Figure 1 is a block diagram overview of one preferred 
exemplary embodiment of the method of the present invention; 

Figure 2 is a block diagram of another present 
exemplary embodiment; 

Figures 3, 4, and 5 are more detailed block diagrams of 
certain aspects of the embodiment referenced in present 
Figure 2 ; and 

Figure 6 is a block diagram of yet another exemplary 
preferred embodiment of the present invention. 

Repeat use of reference characters throughout the 
present specification and appended drawings is intended to . 
represent same or analogous features or aspects of the 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Reference will now be made in detail to the present 
preferred embodiments of the invention, examples of which 
are illustrated in the accompanying drawings. Those of 
ordinary skill in the art will appreciate that the following 
disclosure is for purposes of example only, and is not 
intended to limit broader aspects of the invention 
referenced thereby. * 



Broadly speaking, the method of the present invention 
for the effective compression (and optional transmission) of 
digital imagery data exploits prior known information of an 
image. The method makes use of the fact that images are 
inherently similar and that therefore, a priori knowledge of 
the images can be used in their compression. Such technique 
allows subtraction of two images, for example, one standard 
"healthy" image and one containing data of relative diag- 
nostic significance, including correction for differences in 
orientation and geometry of the features contained in the 
images before subtraction. The image which remains after 
subtraction comprises information due to the differences 
between the images. It is this difference information 
caused by the diagnostically significant data that is 
potentially meaningful and which desirably should be 
preserved for storage and/or transmission. 

Present Figure 1 discloses in general block diagram 
format a first presently preferred embodiment of this inven- 
tion. The illustrated steps are represented in a specific 
sequence, and generally disclose the minimum necessary' steps 
for achieving the present goal of image compression through 
differencing of images which are spatially relatively 
uncorrelated f i.e. . the subject image and the reference 
image) . The illustrated system correlates the images 
through a process which spatially adjusts X-ray images of 
preferably a human thorax by a two-dimensional image warping 
operation which emulates three-dimensional transformations 
of the thorax. Such procedure results in corrected 
differences for location and scale of the thoraxes, as well 
as for relatively small or minor orientational differences, 
it is particularly advantageous that the system presently 
represented allows the images involved in the substraction 
process to be relatively uncorrelated. The resulting system 
is applicable because of such features to general teler- * 
adiology and digital image storage applications. 



In addition, the fact that the two above-described 
images are acquired separately and independently from one 
another allows the method to optionally compress and store 
only a small, interactively identified region of interest. 
The remainder or complementary portion of the image may be 
replaced with image data similar to it in a final step, i.e . 
Whenever the difference image is added back to the reference 
image . 

Referring more specifically to Figure 1, an initial 
step 1 involves reading or otherwise obtaining a subject 
image containing digital imagery data. A subsequent step 2 
involves modeling the obtained subject image. Preferably, a 
three-dimensional model is used to provide a modeled subject 
image, as indicated as emerging from such step 2. 

A next step involves registration of the modeled 
subject image with a modeled reference image obtained from 
modeling a relatively unrelated standard reference image, 
preferably upon a three-dimensional model. Present Figure 1 
broadly represents such registration in step 3, which as 
indicated, results in spatial adjustment of images to 
correct for location, scale, and orientation differences. 

In other words, the modeled subject image and modeled 
reference image are translationally correlated, with the 
resulting correlation of the modeled images in spatial and . 
spectral dimensions. 

What emerges from registration step 3 may be referred 
to as a modeled reference image as well as a modeled subject 
image, both of which are forwarded to a subtraction step or 
difference step 4. In such step, the modeled reference 
image and modeled subject image are differenced to form what 
may be termed a differenced image, which may be subsequently 
compressed in compression step 5. 

In the foregoing exemplary methodology, the subject 
image may contain medical imagery containing data of rela* 
tive diagnostic importance. Particularly in connection with 
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such specific methodology, the preferred method may further 
include interactive editing of the subject image prior to 
the modeling thereof, so that an area of interest encompass- 
ing data of relative diagnostic importance may be specified. 

5 Such interactive editing may including viewing of the 

subject image by an operator with operator designation of 
the defined area of interest. 

Where the subject image includes medical imagery 
containing data of relative diagnostic importance, the 
10 three-dimensional model preferably is representative of a 

particular element contained in the subject image, with the 
resulting standard reference image being equivalent to the 
subject image without the imagery data of relative 
diagnostic importance. 

15 In addition to the foregoing, the preferred methodology 

may also include the step of reducing the differenced image 
prior to compression of such differenced image, so as to 
provide a reduced differenced image for compression. 

It is to be further understood that such methodology 
20 may optionally include an additional step of transmitting 

and/or storing the compressed differenced image for subse- 
quent decompression and reconstitution thereof. Decompres- 
sion preferably would involve decompressing the compressed 
differenced image so as to provide a decompressed 
25 differenced image. Such reconstitution may comprise combin- 

ing the decompressed differenced image with the modeled 
referenced image (or the same information at a remote loca- 
tion) so as to form a reconstituted subject image. 

The modeling step 2 of present Figure 1 may comprise an 
30 image warping operation incorporating image warping 

algorithms. Such image warping operation preferably 
emulates three-dimensional transformation of a two- 
dimensional image into a three-dimensional representation of 
itself based upon the three-dimensional model referenced * 
above and transformation back into a corresponding warped 
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two-dimensional image. Such three-dimensional model pre- 
ferably comprises a computer-generated model of a component 
element common to the subject image and the reference image. 

Additionally as to the foregoing exemplary methodology, 
a standard reference image is preferably adapted to be 
correlated with subject images originating from more than 
one image source. Also, a region smoothing operation may be 
performed to the differenced image to decrease undesired 
noise therefrom. Separate from immediate transmission of a 
compressed image, the compressed differenced image may be 
stored on location or* at an intermediate storage location, 
for subsequent recall and decompression thereof. 

In further accordance with another exemplary embodiment 
of the present invention, a present exemplary method 
commences with the operation of obtaining a subject image 
containing data of relative diagnostic importance. As 
embodied herein and shown for example in Figure 2, such 
method 10 begins with a subject image 12 which includes data 
of diagnostic importance 14. The source of the subject 
image 12 is not a critical element of the invention. Tfence, 
the invention is applicable to subject images 12 originating 
from a variety of known digital imagery sources, such as 
radiography, satellite photography and imaging, etc. The 
data of relative diagnostic importance 14 can be virtually 
any information contained in the image desired to be 
diagnosed for potential analytical purposes. 

Such exemplary method of the present invention 
preferably further includes interactive editing of the 
subject image whereby an area of interest is identified, 
with the area of interest encompassing at least the diag- 
nostically important data. As represented in Figure 2, 
interactive editing 16 comprises a method whereby the sub- 
ject image 12 is designated with an area of interest 18. 

This can be accomplished by various known means, details df 
which do not form a particular aspect of this invention. In 



one preferred embodiment of the invention, editing 16 may be 
accomplished by direct operator viewing of subject image 12 
and designation of an area of interest 18 by any applicable 
means. In a preferred embodiment, an operator may view the 
subject image 12 displayed on a CRT screen and designate the 
area of interest 18 with a light pen. Alternatively, the 
editing 16 may be accomplished automatically by computer 
designation of predetermined portions of the subject 
image 12. Although the area of interest 18 may contain 
additional data, it should at least contain the data of 
diagnostic importance' 14 . 

In one .alternative embodiment, editing 16 may also 
include the designation of portions of the subject image 12 
which will later be used for registration 26 and modeling 
functions 20. For example, in the editing of a subject 
chest X-ray, the operator may directly designate an area of 
interest which includes the outline of the thorax for use in 
the modeling step and edges of the spine for use in the 
registration step. In a preferred embodiment, the operator 
merely designates the portion of the subject image 12 con- 
taining the data of diagnostic importance 14 as the area of 
interest 18. Preferably, software automatically recognizes 
the component of the subject image 12 to be used in the 
modeling process 20 and the registration process 26. 

As embodied herein and depicted in Figures 2 and 3, 
such exemplary method of the present invention further 
comprises the operation 20 of modeling the subject image 12 
upon a three-dimensional model 22 representative of a 
particular element contained in the subject image 12 so as 
to provide a modeled subject image 24. Following the model- 
ing operation subject image is registered to the reference 
image. Preferably, the registration process 26 comprises an 
image warping operation 52 as shown in Figure 3. The image 
warping operation 52 incorporates image warping * 

algorithms 52 to emulate three-dimensional transformation of 



a two-dimensional image (subject image 12) into a three- 
dimensional representation 54 of itself based upon a three- 
dimensional model 22 and back into a corresponding warped 
two-dimensional image 57 with reassigned pixel values 
corresponding to the three-dimensional representation. Such 
modeling operation 20 provides a modeled subject image 24. 
Various image warping techniques and algorithms are well- 
known to those of ordinary skill in the art (see for 
example, prior art patents referenced above) ; and details 
thereof need not be discussed herewith for a full under- 
standing and appreciation of the present invention. 

The modeling function 20 also correlates the subject 
image 12 to the model 22 so that the three-dimensional 
representation 54 "fits" the model 22. The subject image 12 
is correlated to the model 22; the model 22 is not 
correlated to the subject image 12. 

The three-dimensional model 22 is a representative 
model of a particular component depicted in the subject 
image 12. The model 22 need not be an exact model of the 
component in the subject image 22, but merely a close enough 
approximation to allow the warping algorithms for register 
the subject image 12 to the reference image (30) . Thus, it 
should be understood that the model 22 can be used for 
subject images 12 originating from various sources and is 
not restricted to any one subject image 12 originating from 
any one source. In the preferred embodiment of the inven- 
tion, the model 22 comprises a computer-generated model of a 
component element common to the subject image 12 and the 
reference image 30. For example, the model 22 can comprise 
a computer-generated model of a human thorax where the 
subject image 12 constitutes a chest X-ray. 

As embodied herein and shown for example in Figures 2 
and 4, such exemplary method of the present invention 
further comprises the process of registration 26 of the * 
modeled subject image 24 with a modeled reference image 28. 



It is well known to those skilled in the art that, prior to 
subtraction, images preferably should be registered to 
provide an artifact-free differenced image. Various regis- 
tration methods themselves are generally well known in the 
art and any such method (such as edge recognition and com- 
parison or point recognition and comparison) are considered 
within the scope and spirit of this invention. 

The modeled reference image 28 is obtained from the 
modeling 20 (as described above) of a standard reference 
image 30 upon the same three-dimensional model 22 that the 
subject image 12 was ‘modeled upon. It should be understood 
that, since the subject image 12 and reference image 30 are 
modeled upon the same common model 22, the resultant modeled 
subject image 24 and modeled reference image 28 can be 
translationally correlated, correcting for any orientational 
and translational disagreement. In other words, there is 
correlation of modeled images in spatial and spectral 
dimensions. 

The standard reference image 30 is the relative 
equivalent of the subject image 12 without the data of 
relative diagnostic importance; in essence, a "healthy” 
image (such as where patient X-rays are involved) . It 
should be understood that the reference image 30 and subject 
image 12 need not be related in the time dimension, spectral, 
dimension, or spatial dimension. The method 10 corrects for 
any differences between the images in such respects. The 
fact that method 10 (and other present exemplary embodiments 
of this invention) allows such images to be relatively 
unrelated is particularly important for applicability of the 
system in general teleradiology and digital image storage 
situations. Thus a reference image 30 may be kept on file 
for repeated use with relatively unrelated "fresh" subject 
images 12. Additionally, the reference image 30 need not 
come from the same source as the subject image 12. In ond 
embodiment of the present invention, reference image 30 may 



be correlated with subject images originating from more than 
one subject source. For example, in the case of a chest 
X-ray, a standard reference chest X-ray may used for subject 
chest X-rays from patient A, B, or C. 

As depicted by the dashed lines in Figures 2 and 3, the 
modeling 20 concerning reference image 30 can be accomp- 
lished at virtually any time so long as a modeled reference 
image 28 is provided prior to the differencing operation 32. 
In a preferred embodiment of the invention, modeling 20 of 
the standard reference image 30 is accomplished prior to 
obtaining the subject image 12 and stored for subsequent use 
with the remainder of method 10. In such manner, additional 
time need not be expended to generate the modeled reference 
image 28. 

Besides correlating the modeled subject image 24 and 
modeled reference image 28 in the spatial dimension, the 
registration process 26 also registers the images in the 
spectral dimension. Spectral registration is provided to 
correct for global gray scale differentials existing between 
the modeled images caused by the use of different equipment, 
processing methods, time dependent variations in exposure 
intensity between the images, and the like. Spectral regis- 
tration ensures that a gray scale difference between the 
images will not "mask" any true difference. Methods of gray 
scale transformation and correction are well known in the 
art and selection and use of any such method is within the 
scope of this invention. The object of the gray scale or 
spectral registration is to convert the contrast levels 
(gray scale value) of one of the modeled images into the 
value of the other, i.e. . to match gray scale values, 
thereby automatically correcting for contrast differences 
between the images. 

The present invention further includes the process of 
differencing the modeled subject image and modeled reference 
image. Forms of digital image differencing for image en- 
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hancement have been known in the art for some time and are 
understood by those skilled in the art. Basically, 
differencing enhances images by removing contrast detail 
information which is similar in the images. The information 
5 in the differenced image is presumed to be diagnostically 

(er for other reasons) interesting. The differenced image 
contains sharply reduced intensity values in the regions 
where the contrast detail of the original images are 
similar, and normal intensity values in the regions where 
10 the images are appreciably different. Hence, the contrast 

between this difference information and the background is 
enhanced. .It is understood by those in the art though that 
when images are differenced, they are not typically com- 
pressed. A differenced image which comprises entirely eight 
15 bit, low intensity pixels is as large as the image which 

contains the same number of eight bit pixels, but which 
displays maximum contrast detail. 

As embodied herein and depicted in Figures 2 and 4, the 
method 10 includes the operation 32 of differencing the 
20 modeled subject image 24 and modeled reference image 28 so 

as to provide a differenced image 34. The differenced 
image 34 comprises noise, some information due to mis- 
registration of the images, and information due to true 
differences between the images (data 14 of relative diagnos- 
25 tic importance) . The differenced image 34 includes at least 

the previously identified area of interest 18, which 
encompassed portions of the subject image 12 containing 
potential diagnostically important data 14. Hence, the 
method 10 is also useful as a diagnostic tool, since 
30 abnormalities in the subject image 12 are amplified in the 

differenced image 34. 

In an alternative embodiment of the invention as 
embodied herein and shown for example in Figures 2 and 4, 
the method 10 further comprises (optionally) a region * 

35 smoothing operation 55 to eliminate noise from the 
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differenced image 34. The region smoothing process 55 
employs known medium or noise: one embodiment of the pre- 

sent invention makes use of the fact that a difference image 
can be compressed more efficiently than the high contrast 
5 original images, as the system of the present invention 

applies a compression algorithm to the difference image, 
which algorithm includes the step of image segmentation to 
reduce fluctuation of the image function in the difference 
image and thereby allow greater compression ratios. 

10 Application of such potent compression algorithms to the 

difference image rather than the subject image reduces the 
artifacts which such algorithms often cause. 

One method of the present invention further optionally 
comprises the operation of reduction of the differenced 
15 image to provide a reduced differenced image which includes 

at least the previously identified area of interest. The 
differenced image is reduced by removing portions of infor- 
mation therefrom that will still be contained in the final 
image but which will come from the reference image. There- 
20 fore, the final image will appear "whole" even though only a 

portion of the subject image was actually compressed. 

As embodied herein and depicted for example in 
Figures 2 and 4, the method 10 may include reduction 
operation 36. In reduction 36, the differenced image 34 is 
25 edited or "trimmed" of the portions outside the previously 

identified area of interest 18. Various known conventional 
means can be utilized to so reduce the differenced image 34. 
Preferably, an editing program or the like is used to auto- 
matically eliminate portions of the differenced image out- 
30 side the area of interest 18, with such "eliminated" 

portions being subsequently replenished such as from the 
standard reference image or data. In an alternative embodi- 
ment, an operator can designate which portions of the 
differenced image 34 are to be eliminated. The concept of*a 
reduction operation 36 of the differenced image 34 is not 
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crucial to the spirit of the invention and can be 
accomplished in any known applicable manner. 

The foregoing exemplary method of the present invention 
may further optionally comprise the feature of enhanced 
5 compression of at least the area of interest of the reduced 

differenced image. The broad concept of compression per ££ 
of digital imagery is widely known in the art and need not 
be explained here in detail for a full and adequate under- 
standing of this invention. Practice of the present inven- 
10 tion, however, greatly enhances the effectiveness of even 

such conventional compression operations beyond the prior 
achievements of such conventional methods operated by them- 
selves. By applying known compression algorithms to the 
reduced differenced image, the invention exploits the fact 
15 that such algorithms are more efficient at compressing 

images with a lower dynamic intensity range. 

For example, a typical X-ray image has an expected 
dynamic intensity range of values from 0 to 255, which 
requires 8-bit units to store the data. Differencing may 
20 reduce the expected range to less than 0 to 64, which 

requires 6-bit units to store the data, thereby reducing the 
total amount of data contained in the image. Secondly, 
practice of the present invention allows for reduction of 
the difference image file to an identified region of 
25 interest, thereby greatly reducing the amount of data to be 

subsequently compressed. Thirdly, the invention exploits 
the fact that compression of a differenced image results in 
less severe artifacts being generated by the compression 
algorithms. Hence, stronger compression tools can be used 
30 on a differenced image without sacrificing reliability. 

As embodied herein and shown for example in Figures 2 
and 5, method 10 preferably includes the process of enhanced 
compression 38 of at least the area of interest from the 
reduced differenced image 39 so as to provide a compressed 
differenced image 40. In the exemplary preferred embodi- 
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ment of the invention as shown in Figure 5, compression 38 
is accomplished with conventional compression algorithms 56, 
with practice of the overall method 10 resulting in more 
efficient use of such algorithms 56, as explained above. 

5 The foregoing exemplary method of the present invention 

further optionally includes the step 42 of transmission of 
the compressed differenced image to a predetermined receiv- 
ing station whereby the compressed area of interest can be 
subsequently decompressed for addition to a duplicate of the 
10 standard reference image. Transmission can be accomplished 

by conventional known* means, for example, via 9600 baud 
telephone lines. Due to the enhanced compression and 
increased compression ratios, the time required for trans- 
mission is greatly reduced as compared to conventional 
15 methods . 

As embodied herein and shown for example in Figures 2 
and 5, such exemplary method 10 includes the optional step 
of transmission 42. In such preferred embodiment of the 
invention, standard 9600 baud telephone lines are utilized 
20 whereby the compressed difference image 40 is transmitted to 

a desired receiving station (which may be an "end" destina- 
tion or an intermediate storage location from which subse- 
quent transmission to an "end" station is made) . The only 
requirement for the receiving station (if it is an "end" 

25 station at which reproduction is desired) is that it have a 

duplicate 48 of the standard reference image 30 for 
addition 46 to the decompressed reduced area of interest 39, 
and that it have the applicable hardware/software to perform 
decompression 44 and addition 46. Preferably, the receiving 
30 station is in possession of the duplicate reference image 48 

well ahead of the expected transmission time. 

Decompression 44 may be accomplished with conventional 
(de) compression algorithms 56 ( see Figure 5). 

Decompression 44 is a widely known technique to those ■* 
skilled in the art. The addition process 46 comprises the 
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operation of combining the duplicate reference image 48 with 
the decompressed area of interest 39. This results in an 
approximated (or reconstructed) subject image 50 which is a 
relatively precise approximation of the original subject 
5 image 12. The portions of the differenced image 34 elimi- 

nated by the reduction process 36 are present in the 
approximated image 50 since they are never eliminated from 
the duplicate reference image 48. In essence, the approxi- 
mated subject image 50 represents a complete picture com- 
10 posed of the area of interest 18 of the subject image 12 and 

with the reference image 30 comprising the remainder of the 
picture. 

Storage of digital images can be quite expensive, 
requiring vast storage space. Due to the enhanced compres- 
15 sion achieved with the present invention, storage require- 

ments are greatly reduced. In a preferred embodiment of the 
invention as shown in Figures 2 and 5, the method 10 further 
optionally includes an enhanced intermediary storage 
capability 43 whereby the compressed differenced image 40 
20 can be stored and repeatedly recalled for subsequent decom- 

pression 44. Any conventional means for storing digital 
data can be employed. For example, the image 40 can be 
stored on magnetic tape, storage disc, etc. Such storage 
function 43 can exist at the transmitting station, the 
25 receiving station, or at an intermediary station. 

In further accordance with the present invention, the 
foregoing method is provided for the effective compression 
and transmission of radiographic imagery exploiting prior 
known information of the image. The following briefly 
30 overviews an exemplary present process specifically in the 

context of X-rays. As embodied herein and shown for example 
in Figures 2 through 5, a subject X-ray 12 comprising data 
of relative diagnostic importance 14 is obtained. The 
subject X-ray 12 undergoes interactive editing 16 to * 

identify an area of interest 18. 
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The modeling operation 20 incorporates image warping 
algorithms 53 to generate of three-dimensional represen- 
tation 54 of the subject X-ray 12 based upon a computer- 
generated three-dimensional model 22 representative of a 
particular element contained in the subject X-ray 12. 

A standard reference X-ray 30 is modeled according to 
the same process 20, and upon the same computer-generated 
three-dimensional model 22, to provide a modeled reference 
X-ray 28. The standard reference X-ray 30 is the relative 
equivalent of the subject X-ray 12 without the 
diagnostically important data 14. 

The modeled reference X-ray 28 and modeled subject 
X-ray 24 then undergo the registration process 26, and then 
undergo a differencing operation 32. The differenced 
X-ray 34 may then undergo reduction 36, followed by 
compression 38. 

The compressed differenced X-ray 40 is then subjected 
to either a transmission operation 42 or storage 
operation 43 for recall and later use. In either event, 
during any subsequent decompression operation 44, a dupli- 
cate standard reference X-ray 48 is used to form an 
approximated subject X-ray 50. 

An exemplary embodiment of the present invention 
directed more specifically to the compression and transmis 7 
sion of chest X-rays is depicted in Figure 6. A subject 
chest X-ray 61 comprising data of relative diagnostic 
importance 14 is obtained. The subject chest X-ray 61 
undergoes a process of interactive direct operator edit- 
ing 16 whereby the operator determines and identifies an 
area of interest 18 of the subject chest X-ray 61 which 
includes at least the diagnostically important data 14. 

The subject chest X-ray 61 is then subjected to a 
modeling process. Although not specifically designated in 
Figure 6, such modeling process is preferably the equivalent 
of the modeling process depicted in Figures 2 and 3. Some 



time prior to modeling of the subject chest X-ray 61, a 
relatively unrelated standard reference chest X-ray 64 is 
modeled according to the same process used on the subject 
chest X-ray 61, and upon the same computer-generated three- 
dimensional thorax model 60, so as to provide a modeled 
reference chest X-ray 68. The standard reference chest 
X-ray 64 is the relative equivalent of the subject chest 
X-ray 61 without the diagnostically important data 14. 
Following the modeling process the subject image undergoes a 
registration process, which registration process incor- 
porates image warping algorithms 53 to spatially correct the 
subject image eliminating spatial differences between 
subject and reference images. 

The reference chest X-ray 68 and registered subject 
chest X-ray 66 then undergo a differencing operation 32 and 
region smoothing operation 55 so as to provide a differenced 
chest X-ray 70. At a minimum, the differenced chest X- 
ray 70 includes the previously identified area of interest 
18 which encompasses at least the data of diagnostic 
importance 14. 

The differenced chest X-ray 70 then undergoes a 
reduction process 36 to provide a reduced differenced chest 
X-ray 72. The reduction process 36 eliminates unwanted 
portions of the differenced chest X-ray 70 with the reduced, 
differenced chest X-ray 72 comprising at a minimum the area 
of interest 18. 

At a minimum, the reduced area of interest 39 of the 
reduced differenced chest X-ray 72 then undergoes a com- 
pression process 38. The compression process 38 utilizes 
compression algorithms to produce a compressed differenced 
chest X-ray 40. 

The compressed differenced chest X-ray 40 is then 
subjected to a transmission operation 42 whereby the chest 
X-ray 40 is transmitted to a receiving station. Optionally, 
the compressed differenced chest X-ray 40 may undergo 



storage 43 at the same or a remote location for recall and 
later use. At the receiving station, the compressed 
differenced chest X-ray 40 undergoes decompression 44 so as 
to provide at least the reduced area of interest 39. The 
reduced area of interest is then combined with a duplicate 
standard reference chest X-ray 74 to provide a precise 
approximated subject chest X-ray 76. 

It should be apparent to those skilled in the art that 
various modifications and variations can be made in the 
method of the present invention without departing from the 
scope and spirit of the invention. Likewise, it will be 
understood that the foregoing language is by way of example 
only, and is not intended as limiting broader present 
features and aspects. Thus it is intended that the present 
invention cover the modifications and variations of this 
invention provided they come within the scope of the 
appended claims and their equivalents. 



ABSTRACT OF THE DISCLOSURE 
A process for X-ray registration and differencing 
results in more efficient compression. Differencing of 
registered modeled subject image with a modeled reference 
image forms a differenced image for compression with conven- 
tional compression algorithms. Obtention of a modeled 
reference image includes modeling a relatively unrelated 
standard reference image upon a three-dimensional model, 
which three-dimensional model is also used to model the 
subject image for obtaining the modeled subject image. The 
registration process of the modeled subject image and 
modeled reference image translationally correlates such 
modeled images for resulting correlation thereof in spatial 
and spectral dimensions. Prior to compression, a portion of 
the image falling outside a designated area of interest may 
be eliminated, for subsequent replenishment with a standard 
reference image. The compressed differenced image may be 
subsequently transmitted and/or stored, for subsequent 
decompression and addition to a standard reference image so 
as to form a reconstituted or approximated subject image at 
either a remote location and/or at a later moment in time. 
Overall effective compression ratios of 100:1 are possible 
for thoracic X-ray digital images. 
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